Better 

Beginnings 



PARTNERING WITH FAMILIES FOR EARLY 
LEARNING HOME VISIT OBSERVATIONS 



Kristin Hallgren 
Kimberly Boiler 
Diane Paulsell 

April 2010 



MATHEMATICA 

Policy Research, Inc. 




BETTER BEGINNINGS 



The Early Learning Initiative 



I n 2006, the Gates Foundation launched the Early Learning Initiative to improve the school readiness of 
Washington State's children through three main strategies: (1 ) development of high-quality, community- 
wide early learning initiatives in two communities; (2) enhancement of statewide systems that support early 
learning; and (3) support for implementation of promising practices. The foundation joined with other 
private funders and state officials to form Thrive by Five Washington to energize development and support 
of high-quality early learning opportunities for all children in the state. 

In tandem with the formation of Thrive by Five Washington, the Gates Foundation sought two communities 
with a high level of need for early learning services and the capacity to develop and implement high-quality, 
community-wide early learning initiatives. After researching possibilities and consulting with community 
stakeholders, the Gates Foundation selected White Center, an unincorporated area just outside Seattle, and 
East Yakima, a neighborhood in the central Washington community of Yakima. Thrive by Five has worked 
with an intermediary agency in each community to develop and implement the initiative. In East Yakima, 
Educational Service District 105 serves as intermediary through its Ready by Five (Rb5) project. In White 
Center, Puget Sound Educational Services District (PSESD) operates the White Center Early Learning Initiative 
(WCELI). Three key partners, Child Care Resources, the Seattle King County Department of Public Health, 
and Open Arms Perinatal Services, work with PSESD to manage the initiative and provide services. 

Both Early Learning Initiative demonstration communities are implementing a program called Partnering 
with Families for Early Learning (PFEL) as part of the home-based early learning (HBEL) services for the 
Early Learning Initiative. PFEL is a newly designed home visiting program that draws on several curricula, 
including Partners in Parenting Education and Promoting First Relationships. Staff from both communities 
worked together with Thrive by Five to develop PFEL, which was piloted from the fall of 2008 through the 
summer of 2009. (For more information about HBEL services, including PFEL, see Developing Home-Based 
Early Learning Systems in East Yakima and White Center, Kristin Hallgren, Diane Paulsell, and Patricia Del 
Grosso, April 201 0.) 
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I his brief provides an 
overview of the observation 
instruments and describes the 
content and quality of the 
observed PFEL home visits. 



Important characteristics of 
the observed PFEL home visits 
include the length of observed 
home visits, the participants, 
and the language in which 
the visits were conducted. 



Partnering with Families for Early Learning 
Home Visit Observations 

M athematica Policy Research conducted observations of PFEL home visits between fall 2008 
and summer 2009. Trained Mathematica observers conducted three rounds of observations 
of each PFEL home visitor. 1 The primary goal of these observations was to provide feedback to 
the home visit teams in each community about the content and quality of their visits. The teams 
could then use this feedback to support the implementation and quality of their visits. A secondary 
goal was to pilot the observation measures employed for their potential usefulness in assessing 
implementation in future evaluations of PFEL. This brief provides an overview of the observation 
instruments and describes the content and quality of the observed PFEL home visits. 

Certified observers used the Home Visit Characteristics and Content form created by Math- 
ematica (2009) to record information about each visit’s participants and content. Observers 
also used the Home Visit Rating Scales-Adapted (HOVRS-A), created by Lori Roggman and 
her colleagues (Roggman et al. 2008) and adapted with her permission by Mathematica staff 
with input from HBEL staff in both communities. The instrument includes seven five-point 
scales that focus on the quality and nature of interactions during the home visit. Ratings on 
the scales range from one (“Inadequate”) to five (“Good”). 

Because the goals of the observations were to provide formative feedback to the home visiting 
teams and to pilot the observation measures, the sample of observed families is not representa- 
tive of all PFEL families. The analysis of observation data describes only the content and quality 
of observed visits rather than changes over time. In addition, at the time of the observations, 
PFEL staff had not yet finalized the program curriculum, including a visit-by-visit schedule 
or guidelines for visit lengths. Because of this, analysis of home visit observation data could 
not assess the extent to which home visitors achieved fidelity to the PFEL model, nor can it 
compare services between the two communities. Finally, because the HOVRS-A includes scales 
on parent-child interaction, all observations were scheduled for home visits that included both 
the parent and child. As a result, prenatal home visits were not observed. 

Characteristics and Content of Observed PFEL Home Visits 

Collecting information about the characteristics and content of home visits can help describe 
program implementation. Observers used the Home Visit Characteristics and Content form 
to document the basic features and content of PFEL home visits. This section describes the 
observations on these two aspects of the home visits. 

Characteristics and Content of Observed PFEL Home Visits and 
Participants 

Important characteristics of the observed PFEL home visits include the length of observed home 
visits, the participants, and the language in which the visits were conducted (see Table 1). 

Length of Visits. The average observed home visit lasted about an hour (61 minutes). The 
actual length of these visits ranged from 35 to 90 minutes. 2 For about 70 percent of the observed 
home visits, the child enrolled in PFEL was awake for the entire visit. 3 



1 The first round of observations was conducted from November 2008 to January 2009, the second round from 
February to April 2009, and the third round from May to September 2009. 

2 At the time of the observations, PFEL staff had not yet determined guidelines for visit length or whether visit 
length should vary according to the child’s age. 

3 When scheduling observations, observers requested to observe visits in which the child would be awake, but they 
did not reschedule an observation if a child was asleep when the home visitor arrived. 
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TABLE 1. Characteristics of Observed Home Visits 



Children observed during 
home visits ranged in age 
from i week to 9 months old, 
with an average age of about 
3 months. 



Average Length of Visit (Minutes) 


61 


Minimum 


35 


Maximum 


90 


Average Child Age (Weeks) 


11 


Minimum 


1 


Maximum 


36 


Child Awake During Home Visit (Percentage) 


69 


Additional Adults Participating in Home Visit 3 (Percentage) 


57 


Minimum number of adults present 


0 


Maximum number of adults present 


4 


Additional Children Participating in Home Visit (Percentage) 


34 


Minimum number of additional children present 


0 


Maximum number of additional children present 


6 


Home Visit Conducted in (Percentage) 




English 


57 


Spanish 


43 


Other language 


0 


If Home Visit Conducted in Language Other than English, Interpreter 
Used (Percentage) 


73 


Sample Size 


35 



Source: Home visit observations, November 2008-September 2009. 
a All observed home visits included the home visitor and the child's primary caregiver. 



Home Visit Participants. Children observed during home visits ranged in age from 1 week 
to 9 months old, with an average age of about 3 months. All observed visits included the home 
visitor, the mother, and the child. Fifty-seven percent of observed home visits included another 
related adult. One-third of observed visits also included other children, such as siblings, cousins, 
or other children living in the home. The number of additional children present ranged from 
one to six. The potential for distractions from the planned home visit content caused by others 
in the home is discussed later. 

Language of Home Visits. Home visitors conducted 57 percent of the observed home visits 
in English; the rest were conducted in Spanish. In East Yakima, all home visitors relied on 
interpreters during the 1 1 Spanish-language visits. In White Center, one bilingual PFEL home 
visitor conducted all 4 Spanish-language visits. 4 

Content of PFEL Home Visits 

Knowing the activities conducted and content discussed by home visitors can help staff think 
about how these matters might affect the development of home visitors’ relationships with 
families. 5 Observers used the Characteristics and Content Form to identify the activities con- 

4 As part of the formative study of HBEL, Mathematica described HBEL services, including PFEL home visitors’ and 
families’ experiences working with interpreters during home visits. Findings were reported to each community via a 
webinar. 

5 At the time of the observations, PFEL staff had not yet finalized visit-by-visit content. The information recorded 
on the Characteristics and Content form, then, describes what was covered during home visits but is not intended 
to assess how closely the content covered during visits aligned with the PFEL curriculum. 
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